Gaze Tracking Based on Face-Color

In many practical situations, a desirable user interface to a computer system should have a model of where a person is looking at and what he/she is paying attention to. This is particularly important if a system is providing multi-modal communication cues, speech, gesture, lipreading , etc., 2, 3, 8] and the system must identify, whether the cues are aimed at it, or at someone else in the room. This paper describes a system that identiies user focus of attention by visually determining where a person is looking. While other attempts at gaze tracking usually assume a xed or limited location of a per-son's face, the approach presented here allows for complete freedom of movement in a room. The gaze-tracking system, uses several connectionist modules, that track a person's face using a software controlled pan-tilt camera with zoom and identiies the focus of attention from the orientation and direction of the face.